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ABSTRACT 

Objective Earlier detection of pulmonary arterial 
hypertension (PAH), a leading cause of death in systemic 
sclerosis (SSc), facilitates earlier treatment. The objective 
of this study was to develop the first evidence-based 
detection algorithm for PAH in SSc. 
Methods In this cross-sectional, international study 
conducted in 62 experienced centres from North 
America, Europe and Asia, adults with SSc at increased 
risk of PAH (SSc for >3 years and predicted pulmonary 
diffusing capacity for carbon monoxide <60%) 
underwent a broad panel of non-invasive assessments 
followed by diagnostic right heart catheterisation (RHC). 
Univariable and multivariable analyses selected the best 
discriminatory variables for identifying PAH. After 
assessment for clinical plausibility and feasibility, these 
were incorporated into a two-step, internally validated 
detection algorithm. Nomograms for clinical practice use 
were developed. 

Results Of 466 SSc patients at increased risk of PAH, 
87 (19%) had RHC-confirmed PAH. PAH was mild (64% 
in WHO functional class l/ll). Six simple assessments in 
Step 1 of the algorithm determined referral to 
echocardiography. In Step 2, the Step 1 prediction score 
and two echocardiographic variables determined referral 
to RHC. The DETECT algorithm recommended RHC in 
62% of patients (referral rate) and missed 4% of PAH 
patients (false negatives). By comparison, applying 
European Society of Cardiology/European Respiratory 
Society guidelines to these patients, 29% of diagnoses 
were missed while requiring an RHC referral rate of 
40%. 

Conclusions The novel, evidence-based DETECT 
algorithm for PAH detection in SSc is a sensitive, non- 
invasive tool which minimises missed diagnoses, 
identifies milder disease and addresses resource usage. 



INTRODUCTION 

The diagnosis of pulmonary arterial hypertension 
(PAH) is defined at right heart catheterisation 
(RHC) by a mean pulmonary arterial pressure 
(mPAP) of >25 mm Hg with a pulmonary capillary 
wedge pressure (PCWP) of <15 mm Hg. 1 
Additional diagnostic criteria may include a normal 
or reduced cardiac output 1 or a pulmonary vascular 
resistance (PVR) of >3 Wood units. 2 PAH includes 
diverse clinical phenotypes, prominent among 
which is systemic sclerosis (SSc, scleroderma) where 



PAH has emerged as a leading cause of death. 3 4 
Three-year survival for SSc patients with PAH has 
been estimated to be 56% compared with 94% in 
those without PAH. 5 Observational studies have 
demonstrated that mortality remains high in SSc 
patients with PAH despite current best therapy. 6 7 

Poor outcome of PAH in SSc may be partially 
explained by disease-related comorbidities but also 
by delay in diagnosis. One recent study observed a 
better prognosis in subjects identified in an active 
screening programme compared with those identi- 
fied in the course of routine practice, 8 suggesting 
potential benefit of intervention earlier in the 
course of disease. This is consistent with the benefi- 
cial treatment effects demonstrated in early PAH. 9 
Current screening recommendations are largely 
based on consensus. 1 2 Several organisations, 
including the American College of Cardiology 
Foundation/American Heart Association and the 
European Society of Cardiology/European 
Respiratory Society (ESC/ERS), have published a 
variety of screening recommendations relying 
mainly on symptoms and abnormal findings on 
transthoracic echocardiography. 1 2 10 Other clinical 
tools include N-terminal probrain natriuretic 
peptide (NTproBNP) as a marker of myocardial 
stress, 11 and disproportionately reduced pulmonary 
diffusing capacity for carbon monoxide 
(DLCO). 12-14 The most widely used echocardio- 
graphic parameter, tricuspid regurgitant jet (TR) 
velocity, does not accurately reflect invasive pres- 
sures and is not present in all patients. 15 16 
Furthermore, while TR velocity recommendations 
are very specific in current guidelines, recommen- 
dations regarding other evidence of PAH (eg, symp- 
toms) are less detailed; thus, application is likely to 
be variable between clinicians. More importantly, 
no previous screening studies have systematically 
performed RHC in all patients, precluding assess- 
ment of the rate of missed diagnoses (false 
negatives). 

Our study provides evidence-based data guided 
by the principles of screening 17 : (A) employing 
rigorous methodology using the appropriate cross- 
sectional study design in order to determine the 
performance characteristics of the screening algo- 
rithm (sensitivity, specificity, etc); (B) evaluating 
accessible and feasible real-world screening tools; 
(C) identifying patients during an asymptomatic 
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phase of disease (the SSc population in this study has symptoms 
which are not PAH specific) and (D) identifying patients for 
whom subsequent management is appropriate. Using the anchor 
of systematic RHC, the objective of the DETECT study was to 
develop a detection algorithm for PAH in SSc patients that 
would minimise the number of missed PAH diagnoses, while 
optimising the use of diagnostic RHC. 

METHODS 
Study design 

DETECT was designed as a cross-sectional study in which RHC 
and echocardiography were systematically conducted according 
to standardised procedures. Serum laboratory testing and data 
management were performed centrally, and data quality was 
rigorously monitored. DETECT was conducted in accordance 
with the Declaration of Helsinki and its amendments, followed 
the International Conference on Harmonisation Guideline for 
Good Clinical Practice, and was approved by local institutional 
review boards/ethics committees. All patients provided written 
informed consent. 

Study population 

Sixty-two experienced centres (managing at least 40 SSc 
patients) from 18 countries in North America, Europe and Asia 
participated in the study between 2008 and 2011. Patients aged 
>18 years with a diagnosis of SSc (American College of 
Rheumatology criteria, 18 including patients with other connect- 
ive tissue diseases who met these criteria) of >3 years' duration 
from first non-Raynaud's symptom and a predicted DLCO of 
<60% (to enrich for a higher likelihood of PAH), were 
included. Patients were excluded if they had pulmonary hyper- 
tension (PH) confirmed by RHC prior to enrolment, were 
receiving recognised advanced PH therapy, had a forced vital 
capacity (FVC) <40% of predicted, renal insufficiency, previous 
evidence of clinically relevant left heart disease, or were 
pregnant. 

Patients were classified as either non-PH, or WHO group 1 
PH (PAH), WHO group 2 PH (PH due to left heart disease), or 
WHO group 3 PH (PH due to lung disease/hypoxia), according 
to current guidelines. 10 19 WHO group 3 definition was based 
on Study Scientific Committee consensus applying a conserva- 
tive interpretation of the literature to minimise misclassification 
of patients with evident lung disease as PAH. Classification defi- 
nitions are summarised in figure 1. 

Data collection and analysis 

A broad range of variables potentially associated with PAH in 
SSc were assessed (112 in total; see online supplementary text). 
Four groups of variables were: (A) standard demographic and 
clinical parameters (68 variables in total, eg, SSc disease dur- 
ation from first non-Raynaud's symptom, SSc subtype, SSc 
symptoms and organ involvement, general medical history, 
standard physical examination, 6-min walk distance, standard 
pulmonary function tests); (B) serum tests analysed by a central 
laboratory (antinuclear antibody profile (five antibodies), 
NTproBNIJ endothelin-1, von Willebrand factor antigen, 
C-reactive protein, serum urate, creatinine, erythrocyte sedimen- 
tation rate, estimated glomerular filtration rate); (C) electrocar- 
diography (ECG; right ventricular strain, right axis deviation, 
right bundle branch block) and (D) echocardiography according 
to standardised procedures (28 variables in total, eg, right 
atrium (RA) area, right ventricle (RV) area, RA diameter, TR vel- 
ocity, tricuspid annular plane systolic excursion). To minimise 
bias, RHC as the confirmatory diagnostic test (conducted 



according to standardised procedures), was performed in all 
patients following collection of aforementioned data. Serious 
adverse events related to any study-mandated procedure (eg, 
RHC) were collected. 

Statistical methodology 

It was planned to enrol approximately 500 SSc patients includ- 
ing the planned number of 70 patients testing positive for PAH. 
This planned sample size took into consideration feasibility 
aspects of the study and assumed a prevalence rate of 14%. 11 
This sample size was calculated to allow an estimation of 90% 
sensitivity of the detection algorithm with a precision of 
±7.5%. At a similar level of expected specificity, its precision is 
superior, due to the higher prevalence of non-PAH. 

PAH and non-PH groups were described using summary sta- 
tistics; sample size, mean, SD, median, upper and lower quar- 
tiles, minimum and maximum, and 95% CIs of the mean and 
median for quantitative data and frequencies (counts and per- 
centages) for qualitative and categorical data. 

Logistic regression modelling was the main analytical method, 
including linear and non-linear functional relations, where the 
binary outcome variable was PAH versus non-PH. Model-building 
entailed use of statistical procedures; variable selection was 
informed by clinical judgement and internal validation of models 
was performed via the bootstrap method. 

Statistical analysis for selecting predictive variables and devel- 
oping the detection algorithm for risk prediction of PAH was 
performed stepwise in three broad stages (see online supplemen- 
tary text, tables S2-S5 and figures SI and S2): (A) univariable 
and multivariable logistic regression models with RHC-based 
classification of PAH outcome, were applied within each of the 
four above-mentioned groups of candidate variables to select 
those associated with PAH; (B) the selected variables were 
further reduced across groups by using multivariable logistic 
regression; using nominal group technique, the Study Scientific 
Committee excluded some variables based on lack of clinical 
plausibility and/or feasibility with particular regard to resource 
limitations in standard practice and (C) a two-step decision tree 
was constructed based on two multivariable logistic regression 
models. The first step (sensitivity set at 97%) of the decision 
tree included non-echocardiographic tests to produce a risk pre- 
diction score that allowed exclusion of patients at low risk of 
having PAH and determined referral to echocardiography for 
the other patients. In the second step (specificity set at 35%), 
the risk score from Step 1 was combined with echocardio- 
graphic tests to produce the final PAH risk prediction score to 
determine if a patient should be referred to RHC for diagnosis. 
Spline functions with three knots were used in the models to 
adequately address non-linear relationships, which were initially 
identified by quadratic functions during the model-building 
process. Discriminatory performance to distinguish between 
PAH and non-PH patients was examined by receiver operating 
characteristic (ROC) curve analysis. The ROC area under the 
curve (AUC) formed the criterion for assessing the discrimin- 
atory ability of a model. Nomograms 20 were derived from the 
two multivariable risk prediction models (see online supplemen- 
tary text) to allow classification of patients into risk sets for 
referral to echocardiography (Step 1) and RHC (Step 2). An 
alternative algorithm with 65% specificity set in the second step 
was also evaluated, as was the application of the ESC/ERS 
guidelines to the DETECT population. 1 The performance mea- 
sures of the decision tree and its internal validation using boot- 
strap methodology are described in detail in the online 
supplementary text and tables S8-S11. 
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SSc patients screened 

n=646 



-> Screen failures, n=1 58 



SSc patients enrolled 

n=488 



No RHC / consent 
withdrawn, n=22 



RHC analysis set 

n=466 



PH 

mPAP >25 mm Hg 
n=145* (31%) 



Non-PH 

mPAP <25 mm Hg 
n=321 (69%) 



WHO group 1 PH (PAH) 

PCWP <1 5 mm Hg 
n=87(19%) 



WHO group 2 PH (left heart disease) 

> PCWP>15mmHg 
n=30 (6%) 



WHO group 3 PH (lung disease / hypoxia) 

PCWP <1 5 mm Hg 
> FVC <60% or 

60-70% + HRCT not available or 'moderate-severe' 
n=27 (6%) 



Figure 1 Patient disposition. The results reported here focus on the 408 SSc patients with PAH (n=87) and those without PH (n=321; grey boxes). 
*0ne patient could not be assigned to a PH group due to a missing PCWP value. FVC, forced vital capacity; HRCT, high-resolution CT; mPAP, mean 
pulmonary arterial pressure; PAH, pulmonary arterial hypertension; PH, pulmonary hypertension; PCWP, pulmonary capillary wedge pressure; RHC, 
right heart catheterisation; SSc, systemic sclerosis. 



RESULTS 

Of 646 SSc patients screened, 158 did not meet the eligibility 
criteria (mostly due to DLCO values >60% of predicted). Of 
the 488 patients enrolled, 466 underwent RHC which revealed 
PH in 31% of patients (n=145) and PAH (WHO group 1 PH) 
in 19% (n = 87; figure 1). Our results focus on these 87 PAH 
patients versus the 321 non-PH patients. 

Patient characteristics, including RHC findings, are sum- 
marised in table 1. 

In most patients (64%), PAH was mild (WHO functional 
class I or II), with moderately elevated mPAP and pulmonary 
vascular resistance and preserved mean cardiac index. In this 
population, among other variables, exercise capacity on 6-min 
walk test and dyspnoea were not associated with the presence of 
PAH. However, compared with non-PH patients, PAH patients 
were older, more likely to be male, in higher (more severe) 
WHO functional class, more likely to have the limited cutane- 
ous form of SSc, to be anticentromere antibody (ACA) positive 
and to have a history of telangiectasias, had worse gas transfer 
(as assessed by DLCO), higher serum urate and NTproBNP 



levels, were more likely to have a right ventricular strain and 
right axis deviation on ECG, had larger RA and RV areas and 
higher TR velocity. However, when analysing commonly advo- 
cated TR velocity thresholds for PAH suspicion, 1 21 20% of 
PAH patients were found to have a TR velocity of <2.5 m/s, 
36% had a TR velocity of <2.8 m/s, and 63% had a TR velocity 
of <3.4m/s (including 7% of PAH patients with undetectable 
TR velocity). Within the total DETECT cohort, 49% had a TR 
velocity of <2.5 m/s (including 13% with undetectable TR vel- 
ocity). Several other echocardiographic variables (eg, tricuspid 
annular plane systolic excursion) were associated with the pres- 
ence of PAH but did not progress to the final model (see 
below). 

Following univariable and multivariable analyses, and clinical 
judgment of the Study Scientific Committee (based on feasibility 
and clinical plausibility), from an initial 112 variables, 13 were 
selected based on their discriminatory ability to detect PAH (see 
online supplementary text and table S3). These formed the basis 
for constructing a detection algorithm. To align the algorithm 
with real-world practice where the rheumatologist accesses 
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Table 1 Patient characteristics 




Non-PH group (N=321) 


PAH group (N=87) 


Demographics 






Male, n/N (%) 


53/320 (16.6) 


22/86 (25.6) 


Age (years), mean (SD) 


54.7 (1 1 .8) 


61.1 (9.8) 


Caucasian, n/N (%) 


258/319 (80.9) 


81/87 (93.1) 


Body mass index (kg/m 2 ), n 


317 


86 


Mean (SD) 


25.2 (5.6) 


26.1 (5.5) 


SSc characteristics 






SSc duration* (months), n 


319 


87 


Mean (SD) 


130.2 (96.1) 


163.0 (130.3) 


SSc subtype, n/N (%) 






Diffuse 


115/315 (36.5) 


1 8/86 (20.9) 


Limited 


171/315 (54.3) 


61/86 (70.9) 


Mixed/overlap 


29/315 (9.2) 


7/86 (8.1) 


Current/past telangiectasias, n/N (%) 


218/321 (67.9) 


76/87 (87.4) 


Functional capacity 






6-min walk distance (m), n 


243 


66 


Mean (SD) 


412.5 (107.2) 


389.7 (106.6) 


Borg dyspnoea index, n 


240 


66 


Mean (SD) 


2.6 (1.8) 


3.1 (2.1) 


WHO functional class, n 


306 


87 


l/l l/l I l/l V, n (%) 


133 (43.5)/123 (40.2)/50 (16.3)/0 


16 (18.4)/40 (46.0)/30 (34.5)/1 (1.1) 


Pulmonary function tests, n 


321 


87 


DLCO % predicted 






Mean (SD) 


48.0 (9.2) 


43.3 (10.5) 


FVC % predicted/DLCO % predicted 






Mean (SD) 


1.8 (0.5) 


2.2 (0.7) 


Serum markers, n 


306 


80 


NTproBNP (pg/ml) 






Mean (SD) 


230.0 (538.6) 


516.4 (805.0) 


Serum urate (mg/100 ml) 






Mean (SD) 


4.7 (1.5) 


5.9 (1.5) 


ACA positive, n/N (%) 


77/306 (25.2) 


40/80 (50.0) 


Electrocardiography, n/N (%) 






Right ventricular strain present 


7/291 (2.4) 


12/83 (14.5) 


Right axis deviationt present 


10/291 (3.4) 


11/83 (13.3) 


Echocardiography 






Right atrium area (cm 2 ), n 


286 


82 


Mean (SD) 


13.4 (4.7) 


17.1 (6.2) 


Right ventricle area (cm 2 ), n 


291 


82 


Mean (SD) 


15.0 (5.4) 


19.3 (6.8) 


TR velocity (m/s), n 


255 


78 


Mean (SD) 


2.4 (0.5) 


3.1 (0.7) 


TR velocity (m/s), n/N (%) 






'No TR' ticked 


48/303 (1 5.8) 


6/84 (7.1) 


<2.8 


214/303 (70.6) 


30/84 (35.7) 


>2.8 to <3.4 


37/303 (12.2) 


23/84 (27.4) 


>3.4 


4/303 (1 .3) 


25/84 (29.8) 


Haemodynamics on right heart catheterisation 






mPAP (mm Hg), n 


321 


87 


Moan Krrt 

iviean \ju) 


1 /.D \j.O) 


DZ..J \O.D) 


PCWP (mm Hg), n 


318 


87 


Mean (SD) 


8.5 (3.6) 


10.3 (3.2) 


PVR (dyn -sec/cm 5 ), n 


318 


87 


Mean (SD) 


145.4 (64.6) 


370.6 (225.8) 


Cardiac index (l/min/m 2 ), n 


317 


86 


Mean (SD) 


3.0 (0.7) 


2.9 (0.6) 


*From date of first non-Raynaud's symptom. 
tQRS axis >90°. 

ACA, anticentromere antibody; DLCO, pulmonary diffusing capacity for carbon monoxide; FVC, forced vital capacity; mPAP, mean pulmonary arterial pressure; NTproBNP, N-terminal 
probrain natriuretic peptide; PAH, pulmonary arterial hypertension; PH, pulmonary hypertension; PCWP, pulmonary capillary wedge pressure; PVR, pulmonary vascular resistance; SSc, 
systemic sclerosis; TR, tricuspid regurgitant jet. 
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Table 2 Logistic regression models 



Univariable logistic regression models* Multivariable logistic regression models (two-step decision tree) 



ROC AUC,% (95% CI) 



Estimated coefficient (95% CI) 



p value 



ROC AUC,% (95% CI) 



Step 1 
Intercept 

FVC % pred./DLCO % pred. 
Current/past telangiectasias 
Serum ACA (presence) 
Serum NTproBNP (log 10 ) 
Serum urate 

Serum urate (spline componentt) 
Right axis deviation (presence) 
Step 2 
Intercept 

Linear predictor Step 1 
Right atrium area* 
TR velocity 

TR velocity (spline componentt) 



71.5 (65.6 to 77.4) 
59.7 (55.4 to 64.1) 

62.4 (56.4 to 68.4) 

67.5 (60.9 to 74.2) 
71.9 (65.9 to 77.9) 

54.9 (51.1 to 58.7) 



71.2 (65.0 to 77.3) 
79.5 (73.7 to 85.3) 



-12.488 (-16.372 to -8.603) 
1.149 (0.566 to 1.731) 
1.156 (0.336 to 1.975) 
0.753 (0.133 to 1.373) 
0.915 (0.308 to 1.521) 
1.247 (0.497 to 1.997) 

-1.132 (-2.048 to -0.215) 
1.850 (0.507 to 3.193) 

-2.452 (-5.747 to 0.844) 
0.891 (0.559 to 1.224) 
0.075 (-0.004 to 0.154) 
0.209 (-1.117 to 1.534) 
2.656 (0.380 to 4.933) 



<0.001 
0.006 
0.017 
0.003 

<0.001 

0.007 



<0.001 
0.062 
<0.001 



84.4 (79.5 to 89.8) 



88.1 (82.4 to 92.3) 



*The ROC AUC values of the corresponding univariable logistic regression models are added for the sake of comparison. 

tSerum urate and TR velocity were included in the respective models using restricted cubic splines with three knots. Knots for serum urate were selected at 3.3, 4.7 and 
7.1 mg/100 ml and for TR velocity were selected at 2, 2.5 and 3.4 m/s. For each of these two variables only one p value is presented indicating its overall effect. 
tWhen right ventricle area was used instead of right atrium area, the p value was 0.035; the rest of the p values remained with similar results. 

ACA, anticentromere antibody; DLCO, pulmonary diffusing capacity for carbon monoxide; FVC, forced vital capacity; NTproBNP, N-terminal probrain natriuretic peptide; ROC AUC, area 
under the receiver operating characteristic curve; TR, tricuspid regurgitant jet. 



non-echocardiographic data prior to referral to a cardiologist for 
echocardiography, the 13 variables were divided into nine 
non-echocardiographic variables (candidate variables in Step 1 of 
the algorithm) and four echocardiographic variables (candidate 
variables in Step 2). Subsequent multivariable analysis (stepwise 
forward procedure) resulted in six simple assessments being 
included in Step 1 of the algorithm to determine the need for 
referral to echocardiography (table 2). These were: FVC % pre- 
dicted/DLCO % predicted, current/past telangiectasias, serum 
ACA, serum NTproBNP serum urate and right axis deviation on 
ECG. Two echocardiographic variables (RA area and TR velocity) 
were included in Step 2 in order to determine the need for refer- 
ral for RHC. Additionally, Step 2 included the carried-forward 
Step 1 risk prediction score (risk points) (table 2). Of all statistic- 
ally selected final variables, the Study Scientific Committee 
replaced one echocardiographic variable (RV area) with another 
(RA area), because the latter is regarded as easier to assess and 
likely to be more reproducible. This replacement had a minimal 
effect on the performance of the Step 2 model (AUC 89% and 
88% using RVarea and RA area, respectively). The multivariable 
logistic regression models for the two-step decision tree are sum- 
marised in table 2. 

Sensitivity (97% in Step 1) and specificity (35% in Step 2) 
were selected by the Study Scientific Committee with the aim of 
minimising the number of missed PAH diagnoses. The perform- 
ance of the resulting DETECT algorithm is presented in figure 2, 
and a nomogram of the DETECT algorithm for use in clinical 
practice is shown in figure 3. Internal bootstrap validation gener- 
ated consistent results and confirmed overall performance of the 
algorithm (see online supplementary text and tables S8 and S9). 
Exclusion of any single variable from the DETECT algorithm 
had only a small impact on model performance (see online sup- 
plementary text and table Sll). If more than one variable is 
missing, the model cannot be used reliably; in clinical practice, a 
single missing variable should be handled as described in the 
legend to figure 3. Depending on the risk points in Step 1 of the 



algorithm, Step 2 (echocardiography) may not be needed for 
recommending RHC in some patients (figure 3). 

As presented in table 3, the rate of missed PAH diagnoses was 
4% (n=3) applying the DETECT algorithm. The three missed 
PAH patients had mPAP values of 26, 25 and 30 mm Hg, 
PCWP values of 11-12 mm Hg, PVR values of 238- 
257 dyn-sec/cm 5 , TR velocities of 2.9, 2.5 and 2.6 m/s, RA areas 
of 16.4, 15.0 and 8.5 cm 2 , NTproBNP levels of 204, 47 and 
71 pg/ml, no right axis deviation on ECG, and were ACA nega- 
tive. The 4% missed diagnoses rate of the DETECT algorithm 
compares with 29% (n=24; see patient characteristics in online 
supplementary table S7) based on current ESC/ERS guidelines. 1 
The proportion of RHC which did not confirm a diagnosis of 
PAH was similar between the DETECT algorithm and the ESC/ 
ERS guidelines (65% vs 60%). Applying the DETECT algorithm 
recommended referral of 62% of patients to RHC. Reducing 
the RHC referral rate from 62% to 41% (ie, to a similar level as 
the 40% RHC referral rate observed with the ESC/ERS guide- 
lines) increased the rate of missed PAH diagnoses to 15% 
(n=ll) which is still lower than the 29% achieved with the 
ESC/ERS guidelines (table 3). 

Among the 466 patients who underwent RHC, one patient 
had a haematoma caused by accidental carotid puncture. This 
was managed without hospital admission or transfusion. 

DISCUSSION 

DETECT was a large, multicentre, real-world, cross-sectional 
study with detailed population characterisation, standardised 
RHC and echocardiography procedures, central serum testing, 
central data management and rigorous data monitoring. It is the 
first PAH detection study to undertake systematic RHC in all 
patients and to develop an evidence-based algorithm using 
simple clinical data and non-invasive tests for earlier identifica- 
tion of PAH in a mildly symptomatic population. The DETECT 
study demonstrates that within this cohort of SSc patients, PAH 
is much more common than previous studies have suggested, 21 22 
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PAH patients + non-PH patients 
(n=408) 







Stepl 




Non-echocardiographic variables 




FVC % predicted / DLCO % predicted 




Current / past telangiectasias 


Missing data ^ 


Serum ACA 




(n=52) 


Serum NTproBNP 






Serum 


urate 






ECG: right axis deviation 




Total risk points > 300? 






(n=356) 










No referral to echocardiography 


No 


Yes 


True PAH negative (n=50) 


(n=52) 


(n=304) 


False PAH negative (n=2) 












f 



Cut-off for Step 1 
(pre-defined sensitivity 97%) 



97% 



AUC=84.4% 
(79.5%, 89.8%) 



1 -Specificity 



82% 



Cut-off for Step 2: 
(pre-defined specificity 35%) 



Missing data 
(n=37) 



Step 2 

Total risk points from Step 1 plus 
echocardiographic variables 

Right atrium area 

TR velocity 
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Figure 2 Two-step decision tree for detection of pulmonary arterial hypertension in systemic sclerosis patients: the DETECT algorithm. Of the 408 
SSc patients (87 PAH and 321 non-PH) at risk for PAH (SSc of >3 years' duration, DLCO <60% of predicted, FVC >40% of predicted), data from 319 
patients (72 PAH and 247 non-PH) were used for construction of the algorithm. All patients underwent right heart catheterisation. Sensitivity and 
specificity of the two steps of the algorithm (and the corresponding risk point cut-offs) were selected by the Study Scientific Committee with the aim 
of minimising the number of missed PAH diagnoses. Step 1: A complete dataset was available for 356 patients. The combined discriminatory ability 
of the six selected non-echocardiographic variables expressed as the AUC of the ROC curve was 84.4% (95% CI 79.5% to 89.8%) showing good 
discriminatory performance and no statistically significant lack of fit (see online supplementary appendix 5). At Step 1, a predefined sensitivity 
cut-off of 97% (corresponding to >300 risk points, compare figure 3), determined no referral to echocardiography in 52 patients. Among these, 50 
were true negatives (patients without PAH on right heart catheterisation) and two were false negatives (PAH confirmed on right heart 
catheterisation). Step 2: A complete dataset was available for 267 patients. The AUC of the ROC curve for the total risk points from Step 1, plus the 
two selected echocardiographic variables, was 88.1% (95% CI 82.4% to 92.3%). A predefined specificity cut-off of 35% (corresponding to >35 risk 
points, compare figure 3), determined no referral to right heart catheterisation in 69 patients. Among these, 68 were true negatives and one was a 
false negative. Right heart catheterisation in the remaining 198 patients yielded 69 true positives (PAH confirmed) and 129 false positives. Thus, 
overall, the algorithm missed 3 (4%) out of the 72 PAH patients who had sufficient data to be included in the analysis. Note that the algorithm 
uses cut-offs for the risk points of the two steps only but not for individual parameters. ACA, anticentromere antibody; AUC, area under the curve; 
DLCO, pulmonary diffusing capacity for carbon monoxide; FVC, forced vital capacity; NTproBNP, N-terminal probrain natriuretic peptide; PAH, 
pulmonary arterial hypertension; PH, pulmonary hypertension; ROC, receiver operating characteristic; SSc, systemic sclerosis; TR, tricuspid regurgitant 
jet. 
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Figure 3 Nomograms for practical application of the DETECT algorithm: determination of the likelihood of pulmonary arterial hypertension and 
cut-off points for decision to refer a patient to echocardiography (Step 1) and subsequent right heart catheterisation (Step 2). At Step 1 (top panel), 
risk points for each of the six non-echocardiographic variables are calculated by reading from 'Individual risk points in Step 1' and adding them up 
to obtain a total. If the 'Total risk points from Step 1 ' is >300 (corresponding to a sensitivity of 97% as selected by the Study Scientific Committee) 
the patient is referred to echocardiography. Similarly, at Step 2 (bottom panel), risk points for the carried forward 'Total risk points from Step 1 ' and 
the two echocardiographic variables are calculated by reading from the 'Individual risk points in Step 2'. If the 'Total risk points from Step 2' is >35 
(corresponding to a specificity of 35% as selected by the Study Scientific Committee) the patient is referred to right heart catheterisation. 
Alternatively, being less conservative (65% predefined specificity at Step 2), the patient would be referred to right heart catheterisation if 'Total risk 
points from Step 2' is >40 (compare table 3 for the performance of these two options). Note that all variables will always contribute risk points 
irrespective of the measured value; for example, a negative serum ACA will contribute 50 risk points. Exclusion of any single variable from the 
DETECT algorithm has only a small impact on model performance (see online supplementary appendix 9). If a single Step 1 variable is missing it 
should be assigned 50 risk points, with the exception of current/past telangiectasias which should be assigned 65 points. If a single Step 2 variable 
is missing it should be assigned 10 points. The nomograms cannot be reliably used if more than one variable out of the eight total variables is 
missing. ACA, anticentromere antibody; DLCO, pulmonary diffusing capacity for carbon monoxide; FVC, forced vital capacity; NTproBNP, N-terminal 
probrain natriuretic peptide; TR, tricuspid regurgitant jet. 



and can be identified before symptoms are sufficiently advanced 
to be discriminated from general SSc symptoms. 

Previous screening initiatives 21 22 without systematic RHC in 
all patients, resulted in guideline recommendations based on 
symptoms and echocardiography without information on the 



number of missed PAH diagnoses (false negatives). 1 2 10 
Consequently, PAH continues to be diagnosed late with 
advanced symptoms. 6 8 23 Given the evidence that early inter- 
vention may delay morbidity in PAH, 9 and that screening pro- 
grammes that allow earlier treatment in patients with PAH 



1346 



Coghlan JG, et al. Ann Rheum Dis 2014;73:1340-1349. doi:1 0.1 136/annrheumdis-201 3-203301 



Clinical and epidemiological research 



Table 3 Model performance: comparison of PAH detection approaches 

Overall missed PAH 

RHC referral rate, % (positive diagnoses, % (false Overall Overall Overall Overall 

Approach detection assessments/all patients) negatives) sensitivity, % specificity, % PPV, % NPV, % 



Primary analysis 

DETECT algorithm 62 4 

N=319 
Other analyses 

DETECT algorithm with 41 1 5 

65% specificity at Step 2 
N=319 

ESC/ERS guidelines* 1 40 29 

N=371 

*Evaluated on a subset of patients (N=371) with available data for the variables defined in the guideline, using the following criteria for RHC referral 1 : (a) Tricuspid regurgitant jet 
velocity >3.4 m/s; or (b) Tricuspid regurgitant jet velocity >2.8-<3.4 m/s AND symptomatic (defined as at least one of the following DETECT parameters: current anginal pain, current 
syncope/near syncope, current dyspnoea, presence of peripheral oedema); or (c) Tricuspid regurgitant jet velocity <2.8 m/s AND symptomatic (defined as above) AND presence of 
additional echocardiography variables suggestive of pulmonary hypertension (defined as right atrium area >16 cm 2 and/or ratio of right ventricular diameter/left ventricular end diastolic 
diameter >0.8). 

ESC/ERS, European Society of Cardiology/European Respiratory Society; NPV, negative predictive value; PAH, pulmonary arterial hypertension; PPV, positive predictive value (confirmed 
PAH out of all RHC referrals); RHC, right heart catheterisation. 



96 48 35 98 

85 72 47 94 

71 69 40 89 



related to SSc may change the way patients are managed and 
may thus improve prognosis, 8 24 the DETECT algorithm 
addresses a major medical need in this patient population. 
Among all patient populations at risk for developing PAH, SSc 
appears most suitable for screening programmes in terms of 
prevalence and feasibility. 

To align the DETECT approach with clinical practice where 
the rheumatologist may have non-echocardiographic data avail- 
able prior to referral to a cardiologist for echocardiography, a 
corresponding two-step algorithm was developed. This will 
limit echocardiography referral to patients at increased PAH 
risk. Of course, the algorithm can also be used if all data includ- 
ing echocardiography are available at the same time. Sensitivity 
and specificity of the two steps of the algorithm (and the corre- 
sponding risk point cut-offs) were selected by the Study 
Scientific Committee with the aim of minimising the number of 
missed PAH diagnoses as compared with the ESC/ERS guide- 
lines 1 (table 3). Given that the high overall sensitivity (96%) 
selected for the DETECT algorithm is associated with reduced 
specificity (48%), the rate of RHC required in the high-risk SSc 
population included in DETECT is substantial (62%). However, 
the proportion of RHC performed that did not confirm a diag- 
nosis of PAH was similar between the DETECT algorithm and 
the ESC/ERS guidelines (65% vs 60%). Furthermore, overall 
RHC usage when applying the DETECT algorithm in clinical 
practice is likely to be lower than when compared with current 
guideline recommendations, since the latter are applied to the 
general SSc population, without enrichment for high PAH risk. 
For pragmatic reasons (sample size, reasonable expected positive 
predictive value) and ethical considerations (mandated RHC in 
all patients) the DETECT algorithm is designed for application 
in a high-risk SSc population (inclusion criteria DLCO <60% 
and SSc disease duration >3 years). The prevalence of PAH in 
SSc patients with a DLCO >60% is not known but may be as 
low as 1.2%, sevenfold lower than in patients with a DLCO 
<60%. 21 Screening these patients would not reduce the rate of 
missed PAH diagnoses (4% in DETECT) much further, but 
would increase the rate of false positives; the number of RHCs 
needed per PAH diagnosis was three in DETECT, but would be 
six in a population with 10% prevalence and 11 in a population 
with 5% prevalence. In a regularly screened unselected SSc 
population, incidence and prevalence of PAH were found to 



increase progressively, with onset generally after 3 years of 
disease. 25 Based on these data, it is likely that few PAH patients 
were missed in DETECT as a result of the required minimum 
SSc disease duration, and that this criterion contributed to selec- 
tion of a high-risk population. It is possible, however, that some 
PAH patients with very early SSc and preserved DLCO were 
missed. 

Adjusting the specificity of the DETECT algorithm to recom- 
mend similar RHC referral rates (in the DETECT high-risk 
population) as the ESC/ERS guidelines still substantially reduces 
the number of missed PAH diagnoses (table 3). As shown in this 
study and in previous published experience, 26 RHC is a safe 
technique in experienced centres. 

Clinical plausibility, feasibility and applicability of the final 
selected variables were assured by expert input, and their robust- 
ness was internally validated. Some parameters previously identi- 
fied as predictive of PAH were confirmed in DETECT, such as 
FVC/DLCO, 27 telangiectasias, 27 ACA, 27 28 NTproBNI? 11 29 right 
axis deviation on ECG 30 and TR velocity. 8 22 Serum urate has not 
been described previously as being predictive of PAH, but was 
identified as such in this study where low values were associated 
with a low PAH risk. There is, however, some support for an asso- 
ciation in the literature; in a study of 228 patients, serum urate 
levels were significantly higher in those with PAH than in age- 
matched controls, 31 findings that have been corroborated else- 
where. 32 Interestingly, we have demonstrated the limited utility of 
the two main components of current guidelines, that is, symptoms 
and echocardiography: dyspnoea, a prominent symptom of PAH, 
did not discriminate between PAH and absence of PH (which is 
consistent with its lack of sensitivity in identifying cardiopulmon- 
ary compromise in early disease perhaps due to SSc-associated 
restricted musculoskeletal mobility), and TR velocity alone would 
have missed 20% of PAH patients when using a PAH suspicion 
threshold of >2.5 m/s, 36% when using a threshold of >2.8 m/s 
and 63% when using a threshold of >3.4 m/s. 

An expert consensus on criteria for referring SSc patients to 
RHC has been published recently. 33 The objectives, methodology 
and population of this study were different from those of 
DETECT (consensus-based assessment of symptomatic patients 
with suspected PH rather than prospective data-driven assess- 
ment of a primarily screening population without requirement 
for PAH suspicion). Of the criteria proposed by the expert 
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consensus, dyspnoea, physical findings related to the right heart 
and WHO functional class were not sufficiently predictive to 
proceed to the final DETECT algorithm. DLCO (and DLCO cor- 
rected for alveolar volume) was less predictive than FVC/DLCO. 
DETECT confirmed the value of TR velocity as one component 
of the algorithm despite poor performance as a single parameter. 
The predictive value of both RV and RA dilation was confirmed 
in DETECT; RA area is part of the final algorithm. 

The inclusion criteria selected for prevalent SSc patients, 
which may have resulted in an over-representation of limited 
cutaneous SSc. Additionally, the DETECT algorithm was not 
developed to identify other forms of PH; application of the 
DETECT algorithm to the total PH population missed 19% of 
WHO group 2 PH patients, and 37% of WHO group 3 PH 
patients, both of which are common in SSc. The guideline defi- 
nitions used for PH classification in DETECT do not consider 
other variables which may be relevant in clinical practice, for 
example, PVR, echocardiographic parameters to identify left 
ventricular disease, exercise haemodynamics or fluid challenge 
in borderline PH, or elevated transpulmonary gradient that may 
have increased risk of progression to PAH. 34 Pulmonary 
veno-occlusive disease was not considered, since neither system- 
atic radiological assessment nor lung biopsy were performed. 
Finally, the results are based on cross-sectional analyses; it is not 
possible to determine algorithm performance long-term, or to 
recommend how frequently patients should be assessed. Results 
from this study were not validated externally but internal valid- 
ation using well-established methodology (bootstrapping) con- 
firmed that our findings are robust. 

In conclusion, in this cross-sectional multicentre study, we 
have addressed the fundamental flaw in all previous screening 
studies in PH by mandating diagnostic RHC in all patients and, 
thus, determining the false negative rate. The resultant 
DETECT algorithm is highly sensitive, reducing missed diagno- 
ses when compared with the ESC/ERS guidelines and optimising 
resource usage by restricting detection efforts to the appropriate 
high-risk population. Evidence-based guideline recommenda- 
tions for the identification of mildly symptomatic PAH patients 
can now be developed, facilitating earlier intervention. 
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